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IMPLEMENTATION AND USES OF XsRGB 



5 Technical Field 

The present invention relates to colorspace interchange and more particularly, to a new 
color format that can be used for a reference color frame and for internal color space for image 
processing. 

10 Backgroond of the Invention 

Communication of color information between different devices and industries has 
become recognized as an important issue. Each industry generally has its own color 
management history, with its own terminology standards and methods for communicating color 
information. As more users are connecting different peripheral devices made by different 

1 5 companies and, in addition, communicate with one another over the Internet, it is becoming more 
urgent to have a standardized color data management scheme that provides consistent color data 
management. Many different practices and standards are currently being used. 

Different phosphor sets are being used to provide the colors of "red", "green", and 
"blue". For example, where a monitor may illustrate a pink color, and the user selects the pink 

20 color, the printer printing the selection may print out an ugly purple/lavender. Thus, different 

values on chromaticity diagrams represent a same color, providing confusion. Tone reproduction 
of various systems also differs. Also, viewing conditions may vary, causing colors to appear 
different to different observers. Thus, due to differing visual conditions, the color of the 
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illuminant (the white point), the absolute level of the scene irradiance (generally the 
illuminance), the surrounding colors, etc., all affect the color perception unless the initial and 
final conditions are identical. Unless a white point and illuminance level are the same, the color 
interchange data may not be identical. 
5 Previous color data conversion methods have required the use of cube root computation 

or raising values to the third power. To store data, every pixel had to be converted using a set of 
power function routines. This process is time-consuming, consumes processing power, and may 
introduce errors. Other techniques, such as is described in U.S. Patent No. 5,224,178, by Madden 
et al., provide for compressing digital code values to provide a set of reduced range digital codes 

10 of a same resolution, but having a smaller range of basic image content values than the dynamic 
range of the digitized image data base. 

As shown in Figure 1 the chromaticity diagram has been developed by the Commission 
Internationale de FEclairage (CDE), or International Commission on Illumination, to provide a 
common chromaticity value for colors. The displayable colors by a laser device are shown as a 

15 triangle ABC, with points A 102, B 104, and C 106. Ideally, color values for a device should 
cover a triangle having an area that extends over the entire visible range. However, as shown in 
Figure 2, the triangle covered: for color values of a Canon CLC500 color copier/printer 202 is 
shown along with the old RGB color values (Genl. RGB) 204, the first PC color monitors and 
the sRGB values 206. While some of the cyan colors are limited by sRGB, the brightest greens 

20 and reds are output device limited, but not sRGB limited. Clearly, calculations must be used to 
convert values o f the color copier/printer 202 colors to the ordinary CRT colors (sRGB values) 
206. 
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Although lasers have virtually monochromatic output and the primaries of the laser 
would reside on the spectrum locus of the CIE (International Commission on Illumination) 
diagram of Figure 1, showing 2 degree observer data, typically devices do not have the gamut to 
display the laser colorspace. Thus, data in a laser display colorspace would have to be converted 
5 for display and printing. 

Cathode display tubes (CRTs), color flat panels (both active and passive matrix types) 
and high definition televisions (HDTVs) provide chromaticity diagrams that are similar to the 
CRT model shown in Figure 2. However, the sRGB chromaticity diagram lacks a range of 
gamut that includes all colors, and conversion of sRGB color data values is non-linear, thus often 
10 resulting in undesifed results. 

Advanced graphic systems require the features of anti-aliases (removing ragged edges) 
and blending (translucency) effects. Those effects are handled by an extra component, called the 
alpha channel, in addition to the RGB components. In order to perform the anti-alias and 
blending operations correctly with the alpha channel, the linear color components need to be 
1 5 defined in terms of their intensities. Current systems are however limited to the intensity values 
between 0 and 1 , which do not provide optimal results in some circumstances. 

Summary of the Invention 

One aspect of the invention relates to an extended colorspace which has a higher 
20 accuracy and a wider gamut than sRGB color space. The extended color space includes an alpha 
channel which defines the translucency of the color image. The alpha channel is different from 
known alpha channels in that the inventive alpha channel can represent "super transparent" and 
"super opaque" values by allowing the alpha parameter (a) to be greater than 1 and less than 0. 
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A data structure for storing image information for each component of an image is also 
disclosed. The data structure has three fields, a sign field, an integer field and a decimal field. 
The sign field defines whether an integer is negative or positive. The integer field defines the 
integer, wherein the integer defines the super or under saturated values for color and alpha 
5 components. The decimal field defines the fine detailed information for the value of the color 
and alpha components. 



Brief Description of the Drawings 

Figure 1 is a schematic graphical representation of a laser display colorspace upon a CIE 
10 colorspace that shows the full gamut of the visual spectrum as is known in the art. 

Figure 2 is a schematic graphical representation of colorspaces for a representative Canon 
CLC500 color copier/printer, General RGB color values, and sRGB values upon a CIE 
colorspace diagram as is known in the art. 

Figure 3 is a schematic graphical representation of a colorspace in accordance with 
15 embodiments of the invention. 

Figure 4 is a block diagram of an apparatus in a digitized image processing system for 
converting color images in accordance with embodiments of the invention. 

Figure 5 is a block diagram of a computer system that may be used to implement 
embodiments of the invention. 
20 Figure 6 illustrates the alpha value as an interpolation/extrapolation parameter according 

to embodiments of the invention. 

Figure 7 illustrates a RGB48 color format according to embodiments of the invention. 

Figure 8 illustrates an ARGB64 color format according to embodiments of the invention. 
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Figure 9 illustrates a data structure for storing image information for each color 
component according to embodiments of the invention. 

Figures 10(a)- 10(e) illustrate various stages of color data according to embodiments of 
the invention. 

5 

Detailed Description 

As shown in Figure 3, extending the range of color data values for the chromaticity 
diagram for sRGB beyond 1.0 and below 0.0 on the x and y axes is illustrated by the triangle 
DEF 302, 304, 306, so that the present invention provides a chromaticity diagram that 
10 encompasses all visible color values. For example, in one embodiment, color data values may be 
expressed in a signed 16-bit integer (13 bits are used for decimals) with a triangle corresponding 
to (3.24, -0.97, 0.06), (-1:54, 1.88, -0.20), and (-0.50, 0.04, 1.01), thus covering each component 
within -4 to 4. 

By allowing the component of each primary color to be negative and to extend beyond 
15 1 .0 (when normalized to 1 .0 in sRGB), the present invention's gamut is larger than the visible 
color space. The data scheme of the present invention,"XsRGB", is also known as "sRGB64. 
"XsRGB" will be used hereafter to represent the color data scheme of either XsRGB or sRGB64. 

Advanced graphic systems require anti-aliasing features (removing ragged edges) and 
blending (translucency) effects. To achieve these anti-aliasing features and blending effects, an 
20 extra component called an "alpha channel" was introduced. To utilize the alpha channel, the 
linear color components must be expressed in terms of their intensities. However, sRGB and 
other color management systems typically store color data values in non-linear 8-bit values per 
channel. The non-linearity is expressed as a "gamma value". For example, Microsoft's and 
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Apple's color management systems are 2.2 and 1.8, respectively. When only 8 bits were 
available for color data value representation, it was necessary to convert the color data non- 
linearly. Otherwise, it created a large gap in the lower intensity values and causing the resulting 
images to show contours. However, when the size of each component is extended to higher bit 
5 (12 bit or higher), the non-linearity requirement is eliminated. Thus, in an embodiment with 12 
or more bits for each component, component values do not have to be non-linearized, avoiding 
confusion of different gamma values in different color standards. When the super luminous or 
negative values are allowed, color profiles do not require clipping to a narrower gamut. Since, in 
this embodiment, color values are standardized, standard images may be stored in the XsRGB 

10 format without attaching a standardized profile such as an ICC (International Color Consortium) 
profile to clarify the colors intended. Where desired, an alpha channel may be implemented to 
store information on transparency. Also, where selected, the color values may be premultiplied 
by alpha channel values to provide efficient blending. 

It is better to define XsRGB more generally by a 4x4 matrix. Also, there is a conversion 

15 rule for XsRGB with a different white point. 

XsRGB is linear in the visual intensity of each component. Hence, XsRGB can relate 
linearly to 1931 CIE XYZ values. Let R 09 G 0 , and B 0 denote the normalized red, green, and 
blue components, respectively. Let X, Y t and Z denote 1 93 1 CIE XYZ values, but Y is 
normalized to 1 instead of 100. The relationship between the normalized XsRGB and XYZ is 

20 given by a 4x4 matrix. 
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Only 12 coefficients are needed to define XsRGB. In addition to the rotational part (m^ ,etc), 
the transitional part (t R , etc.) is used. With this notation, the white point may be addressed as 
well as the black point. Using the inverse of the above matrix, the reverse relation from XsRGB 
10 to CIE XYZ space is given by: . 
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A 16 bit definition of RGB components is given by: 
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In equation (2c), no gamma corrections are required since a sufficient number of bits are 
available to describe the color data (here, 16 bits). 

It is desirable for XsRGB to have a simple transform to sRGB in D65. D50 and D65 are 
the standard illuminans (the spectrum distributions of the light source) defined by CIE. D50 and 
D65 are the spectrum distributions similar to the Black Body radiation of 5000 and 6500 Kelvin, 
respectively. Indeed, it is desirable for XsRGB to be identical to sRGB when its value is inside 
the range of sRGB. From the sRGB specification, the coefficients of Eq. (lb) and Eq. (2b) are 
determined as: 
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(3a) 



(3b) 



The white point of D65 is {x D6S ,y D6S ) =(0.3127, 0.3291); the corresponding Cffi XYZ values 



are 



^65=^65/^65 =0.9502 
^65=10 

\Z D6S =(l.0-x D65 -y D65 )/y D65 =\MS7 



(4) 



8 



MS# 142373.2 B&W 3 . A86772 
Fsushiki et al. 



Note that the Y-value at the white point is 1 . When the device has the different white point 
(X wy Y w9 Z w ) J the CIE XYZ coordinates for the appearance match must be transformed by the 
scaling matrix. 
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(5b) 



The transformation matrix from XYZ to XsRGB at this white point is given by 
M W =M D65 S W (6a) 
and its transverse matrix is given by 

M w = S w M D6S (6b) 

For an example, the white point of D50 is (x fl50 ,v D50 ) = (0.3457,0.3585). The corresponding 
CIE XYZ value is (X b5Q , Y D50 ,Z D50 ) = (0.9643,1,0.825 1) . Hence the scaling matrices are 
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The resultant transformation matrices for D50 are: 
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M D50 = 
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The appearance match is obtained if the XsRGB values are calculated from the 
conversion matrix of the device white point. The absolute match may be obtained if the 
1 5 conversion matrix of D65 is used irrespective of the device white point. 

Let (R W ,G W ,B W ) denote the normalized RGB value obtained with the matrix M w defined 
in Eq. (6a) for the specific white point The (R w , G w , B w ) value is used to do the appearance 
match and is called the appearance RGB value. When the absolute match is needed, the RGB 
values (R 0 , G 0 , B 0 ) are used by using the matrix Moes defined in Eq. (3a), which is called the 

20 absolute RGB value. The absolute RGB value is obtained from the appearance RGB value by 
the following equation: 
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The reverse relation is obtained as: 
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Since the XsRGB space is directly linked to GIE XYZ space, it is possible to produce the 
XsRGB measuring device. The new XsRGB device may be produced by adding the matrix 
conversion routines to the existing colorimeters. XsRGB values may be measured directly from 
the device. The device may produce the appearance RGB values and the absolute RGB values. 

The default XsRGB space is the case of D65 that is linked to sRGB. Since there is no 
translational part, Eq. (la) with M = Mr>65 can be written with a 3x3 matrix as: 
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(10) 



Allowing each component to go from -4 to 4 by X, Y, Z values, wherein X, Y, and Z 
denote 193 1 CIE XYZ values wherein Y has been normalized to 1 instead of 100, 
covers a range larger than the range covered by XYZ. The equation (10) provides one 
embodiment of a floating point format for XsRGB. When the 1 6 bit version of XsRGB is 
15 utilized, a signed 16 bit integer is used and 8192 (= 2 13 ) is inteipreted as 1 in the normalized 
value. Hence, the lowest 13 bits are used for the decimal portion. 

Conversion from 16 bit color data for the XsRGB format to an 8 bit sRGB format is as 
follows: Let Ci6 and C 8 denote one of the components in 16 bit XsRGB format and 8 bit sRGB 
format, respectively. The relationships are: 
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C 0 s C, 6 / 8 1 92 (Corresponding to the normalized linear XsRGB) 
C 8 =0 for C 16 <0 

C 8 = 12.92 x C 0 x 255 for 0 < C 0 < 0.00304 (0 < C 16 < 24) 

C 8 = (l.055 x C 0 (, 0/ 24) - 0.055)x 255 for 0.00304 < C 0 < 1 (25 < C l6 < 8192) 

C 8 =255 for C 0 >1 (C 1(J >8192) (11) 

The above conversions correspond to clipping below 0 and above 8192 of the 16 bit 
XsRGB when converting to 8 bit sRGB. The clipping routine may be further modified as 
desired. 

The reverse relationships are: 

Ci6 = 2.4865 xC 8 for0< C 8 <10 

C 16 = 8.192 x[(C 8 -hl4.025)/269.025f 4 for 11 < C 8 < 255 . (12) 

The extension of sRGB in accordance with the present invention provides a number of 
advantages. For example, blending operations with an alpha channel may be directly applied to 
XsRGB since XsRGB is linear. The XsRGB profiles may easily be obtained from the ClE XYZ 
profiles. When XsRGB is used for color reference, there is no need to rotate color components 
to display each component in an 8 bit sRGB device. Only gamma correction described in (Eq. 
12) above need be used to convert to 8 bit sRGB. Even without an exact calibration, XsRGB 
yields satisfactory conversion for output for color monitors. The scanned images may generally 
be stored in XsRGB format without losing bit depths since most scanners produce data in not 
more than 12 bits in each color component. 
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Figure 4 is a block diagram of one embodiment of an apparatus in a digitized image 
processing system for converting color images in accordance with the present invention. In the 
digitized image processing system 402, an image digitizer 404 that utilizes color image 
information to output digital signals representing a color image to the apparatus 406 that converts 

5 the digital signals to a high quality error-free expanded colorspace color image. The apparatus 
406 includes: an expanded colorspace mapper 408, for mapping the digital signals to expanded 
colorspace values wherein the expanded colorspace values include values beyond a visible range 
of color values; and an image labeller 410, coupled to the expanded colorspace mapper 408, for 
labeling an image determined by expanded colorspace values as an expanded colorspace image. 

10 The expanded colorspace may include a colorspace defined by a chromaticity diagram that 

extends into negative component values and beyond 1 .0 when normalized to 1 .0 in sRGB. The 
expanded colorspace mapper may utilize multiplication of R 0 , G 0 , B 0 values by a predetermined 

matrix to map the color values to an expanded colorspace. The R Q9 G 0 > B 0 values may be 

obtained using equation (9). Where desired, the color data values and their bit components, 
1 5 clipping, transparency information storage and premultiplication and normalization of color data 
values may be as described for the methods above. 

Color operations defined in the RGB/ARGB colorspace may be extended to the expanded 
RGB/ARGB colorspace. Three examples of color operations in the expanded RGB/ARGB 
colorspace include: 

20 1. Interpolation between two RGB colors X = (R X ,G X ,B X ) and Y = (R y ,G y ,B y ). The RGB 
color Z = (R 2 ,G 2 ,B 2 ) that is linearly interpolated between X and Y is given by: 



R 2 =(\-d)R x +dR y 
G 2 = (l-d)G x +dG y 

B z =(l-d)B x +dB y 
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where d is the normalized distance of Z from X to Y, and d = 0 at X and d = 1 at Y. 

2. Digital image composition operations that combine two non-premultiplied RGBA colors. 
For example, one of the operations, X over Y, where X = (A X ,R X ,G X ,B X ) and Y = 
(A y ,R y ,G y ,B y ), produces color Z = (A : ,R Z> G Z ,B 2 ). The formula is given by: 

R 2 =A x R x+ (\-A x )R y 
G 2 =A x G x +(l-A x )G y 
B z =A x B x +(\-A x )B y 
A z =A X A X + (l-A x )A y 

Note that this formula does not allow associativity for the order of the operations contrast to the 
premultiplied ARGB case discussed below. 

3. Image convolution operations: For example, a blur filter matrix M is given by : 

"1/16 1/8 1/16" 
1/8 1/4 1/8 
1/16 1/8 1A6 

The blur equation is for each color component. Assuming a RGB color component of a pixel at 
location (i, j) is C(i j), the resulting RGB color component of the pixel after the blur operation is 
given by: 

(l/16)C(i-l, j-1) + (l/8)C(i-l, j) + (l/16)C(i-l, j+1) + 
(l/8)C(i, j-1) + (l/4)C(i, j) + (l/8)C(i, j+1) + 
(l/6)C(i+l, j-1) + (l/8)C(i+l, j) + (l/16)C(i+l, j+1) 
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Besides these examples, the illumination and shading used in 3D graphics can be applied 
XsARGB space. 

With reference to Figure 5, an exemplary system for implementing the invention includes 
a general purpose computing device in the form of a conventional personal computer 520, 
5 including a processing unit/processor 521, a system memory 522, and a system bus 523 that 
couples various system components including the system memory to the processing 
unit/processor 521. The system bus 523 may be any of several types of bus structures including 
a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of 
bus architectures. The system memory includes read only memory (ROM) 524 and random 

10 access memory (RAM) 525. A basic input/output system 526 (BIOS), containing the basic 

routines that helps to transfer information between elements within the personal computer 520, 
such as during start-up, is stored in ROM 524. The personal computer 520 further includes a 
hard disk drive 527 for reading from and writing to a hard disk, not shown, a magnetic disk drive 
528 for reading from or writing to a removable magnetic disk 529, and an optical disk drive 530 

15 for reading from or writing to a removable optical disk 53 1 such as a CD ROM or other optical 
media. The hard disk drive 527, magnetic disk drive 528, and optical disk drive 530 are 
connected to the system bus 523 by a hard disk drive interface 532, a magnetic disk drive 
interface 533, and an optical drive interface 534, respectively. The drives and their associated 
computer-readable media provide nonvolatile storage of computer readable instructions, data 

20 structures, program modules and other data for the personal computer 520. Although the 

exemplary environment described herein employs a hard disk, a removable magnetic disk 529 
and a removable optical disk 531, it should be appreciated by those skilled in the art that other 
types of computer readable media which can store data that is accessible by a computer, such as 

15 
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magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access 
memories (RAMs), read only memories (ROMs), and the like, may also be used in the 
exemplary operating environment. 

A number of program modules may be stored on the hard disk, magnetic disk 529, optical 
disk 531, ROM 524, or RAM 525, including an operating system 535, one or more application 
programs 536, other program modules 537 and program data 538. A user may enter commands 
and information into the personal computer 520 through input devices such as a keyboard 540 
and pointing device 542. Other input devices (not shown) may include a microphone, joystick, 
game pad, satellite dish, scanner or the like. These and other input devices are often connected 
to the processing unit 521 through a serial port interface 546 that is coupled to the system bus, 
but may be connected by other interfaces, such as a parallel port, game port or a universal serial 
bus (USB). A monitor 547 or other type of display device is also connected to the system bus 
523 via an interface, such as a video adapter 548. In addition to the monitor, personal computers 
typically include other peripheral output devices (not shown) such as speakers and printers. 

The personal computer 520 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 549. The remote 
computer 549 may be another personal computer, a server, a router, a network PC, a peer device 
or other common network node, and typically includes many or all of the elements described 
above relative to the personal computer 520, although only a memory storage device 550 has 
been illustrated in Figure 5. The logical connections depicted in Figure 5 include a local area 
network (LAN) 551 and a wide area network (WAN) 552. Such networking environments are 
commonplace in offices, enterprise-wide computer networks, intranets and the Internet. 
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When used in a LAN networking environment, the personal computer 520 is connected to 
the local network 55 1 through a network interface or adapter 553. When used in a WAN 
networking environment, the personal computer 520 typically includes a modem 554 or other 
means for establishing communications over the wide are network 552, such as the Internet. The 
modem 554, which may be internal or external, is connected to the system bus 523 via the serial 
port interface 546. In a networked environment program modules depicted relative to the ~ 
personal computer 520, or portions thereof, may be stored in the remote memory storage device. 
It will be appreciated that the network connections shown are exemplary and other means of 
establishing communications between the computers may be used. 

According to one embodiment of the invention, an alpha channel is used to convey 
transparency information about a color and is referred to as "XsARGB". For XsARGB, an 
additional 16 bit component is used to store transparency information. First, a normalized alpha 
channel Ao will be introduced. The values 0 and 1 of Ao are regarded as transparent and opaque, 
respectively. The four components (Ao, Ro, G 0 , B 0 ) constitutes one color value. If each 
component is multiplied by 8192 we obtain the XsARGB component (Ai 6 , Ri 6 , Gi 6 , B 16 ). This 
component is called the non-premultiplied XsARGB and (Ao, Ro, G 0 , B 0 ) is called the 
normalized non-premultiplied XsARGB. The discussion of premultiplied colors will now be 
discussed. 

When an image B is laid on top of an image A, the resultant image P has the pixel value 
P = f}b + (l-f})a 9 (14) 
where a and b are a color component of the images A and B at a certain pixel and fi is the alpha 
channel of the image B at that pixel. An image C can be laid on top of the image P to create 
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another image. We want to create the overlay formula so that the final result does not depend 
the order (associativity). 

C©(B©A) = (C © B) © A. ( 
Let D denote the image created by C and B and one of its color components and alpha 
5 value d and 6, respectively. The equation (9) for each color component can be written as 



yc + (1 - y) [fib + (1 - p)a\ = 6d + (1 - 6)a, ( 1 6) 
where c and y are one of color components and alpha value of the image C at the pixel of 
interest. Comparing the coefficients of a, the alpha value of the composited image D must be 
10 6=p+Y-YP- (17) 

Comparing the rest of the equation (16), the value of the color component, d, multiplied 
by its alpha value, 6 , are given by 

6d= Y c + {\-Y)Pb- . (18) 

15 

Notice that in equation (18) the color components are always multiplied by their alpha 
values. Hence, it is efficient to work with color components that are already multiplied by their 
alpha values. Those colors are called premultiplied colors. 

When blending operations are processed, it is more efficient to use RGB values which are 
20 multiplied by the alpha value. The four components (4, , R' 0 , G' 0 , B' 0 ) where R' 0 = AoR* G' 0 = 
AoGo, and B' Q = AoB 0 , are called normalized premultiplied XsRGB. By multiplying each 
component by 8192, the XsARGB component (A,«, R[ 6 , G' 16 , B', 6 ) is obtained. This 
component is called the premultiplied XsARGB. 
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According to one embodiment of the invention, the alpha value Ao is allowed to go above 
1 and below zero. The meaning of the alpha value can be considered in the following way. 
When a source image, S, is overlaid to the destination image, D the resultant image, D' is 
obtained, as 

5 d f = as + (\-a)d (19) 

where s, d, and d r are one of the normalized color components of the image S, D, and £>'at the 
corresponding pixels, respectively, and a is the alpha value of the source image S at the 
considering pixel. When a = 0, the resultant image remains the same as the destination image. 

10 This case is called transparent. When a = 1 , the resultant image is the same as the source image. 
This case is called opaque. When a is between 0 and 1, the resultant image is the mixed image 
between the source and destination images. Usually a is a translucency parameter ranging 
between transparent (=0) to opaque (=1). However, if equation (12) is studied, it will be noticed 
that equation (12) is nothing but an interpolation equation. Hence, when a < 0 or a > 1, equation 

15 (12) is very well defined and it is extrapolating the source and destination images. Figure 6 

shows the alpha value as an interpolation/extrapolation parameter. The invention allows a to be 
smaller than 0 or larger than 1, wherein a < is called "super transparent" and a > 1 is called 
"super opaque." 

When a XsRGB (16bit each component) color is put into a memory, bits 0-15 are the 
20 blue component, bits 16-31 are the green component, and bits 32-47 are the red component as 
illustrated in Figure 7. Each component is a signed 16 bit integer. The value 8192 is interpreted 
as 1 .0. When it is saved into a file, Intel's Little Endian convention put the first two bytes for the 
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blue component, the next two bytes for the green component, and the subsequent two bytes for 
the red component. This color format is called RGB48. 

Either premultiplied or non-premultiplied, the data structure of XsARGB (16 bit each 
component) remains the same. When a XsARGB (16bit each component) color is put into a 
5 memory, bits 0- 1 5 are the blue component, bits 1 6-3 1 are the green component, bits 32-47 are 
the red component, and bits 48-63 are the alpha component as illustrated in Figure 8. Each 
component is a signed 16 bit integer. The value 8192 is interpreted as 1.0. When it is saved into 
a file, Intel's Little Endian convention put the first two bytes for the blue component, the next 
two bytes for the green component, and the subsequent two bytes for the red component, and the 
10 last two bytes for the alpha component. This color format is called ARGB64. 

When the data is stored linearly, even the 16 bit scale may not be sufficient to store the 
detailed shades. When more details are required for the certain range of each component, a 
special range can be assigned in each component. When each component is normalized, the 
format can allow each component to vary from -4 to +4. However, most values lie within 0 to 1 . 
1 5 Special ranges can be assigned in -4 to +3, -3 to -2, 2 to 3, and 3 to 4 to have different scales 
from the default XsRGB and XsARGB. A user can specify those ranges and define it in the 
image header. Hence XsRGB and XsARGB can contain multi-color resolution data. 

The variation of color format for lower bit depths can be defined. The possible formats 
are as follows: 

20 32 bit XsRGB - 1 0 bit in each component (8 bit decimal field) and 2 bit extra. 
36 bit XsRGB - 12 bit each component (10 bit decimal field). 
40 bit XsRGB - 13 bit each component (1 1 bit decimal field) and 1 bit extra. 
40 bit XsARGB - 10 bit each component (8 bit decimal field). 
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48 bit XsARGB - 12 bit each component (10 bit decimal field). 

As illustrated in Figure 9, the data structure for storing image information for each color 
component of the image is divided into several fields. The first field is a one bit sign field 901 
for defining whether an integer value representing the bound of colorspace is positive or 
negative. The second field is the integer field 903. The integer field defines the value of the 
bounds of the colorspace. The integer field comprises at least one bit. If the integer field 
comprises one bit, the integer can be equal to one of two integer values. If the integer field 
comprises two bits, the integer can be equal to one of four possible integer values. The third 
field is a decimal field 905 which defines color data information regarding the color value of the 
component. The more bits that the decimal field contains, the greater the number of color values 
the component can be assigned. For example, if the decimal field comprises 9bits, the color 
values can range from 0 to 51 1, and if the decimal field comprises 10 bits, the color values can 
range between 0 and 1023. Thus, there is a trade-off between how many bits to allot to the 
integer field and the decimal field. 

In addition to the higher accuracies, RGB48 and ARGB64 have the extra ranges below 0 
and beyond 1 (in terms of the normalized values). This gives significant advantages in images 
filtering. For example, suppose a series of filters,/!,^,. . .,/ n is applied. In each filter, the 
component value may go below 0 or go above 1. If the color value is truncated in each filter, the 
correct result may not be obtained in the end For an example, 



The correct result of f 2 o /, (*) = f 2 (/; (*)) should be x itself. However, if/i is truncated 
between 0 and 1, the result of f 2 o f x ( x ) becomes 0.5 for all x < 0.5. 




(20) 
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The existing image format forces the resultant image to be clipped in each filter. Hence, 
the final result is likely to be incorrect. This will cause artifacts to appear in the image. With the 
excess range in the color space of the invention, the intermediate results are not clipped. Only 
the final result is clipped to the range of the output device. To further illustrate this point, Figure 
5 1 0(a) illustrates the color data for a red component which has a peak value of 200. If the red 
component is shifted by some operation by 120, some of the color data will be greater than 255. 
The color data which has a value greater than 255 is clipped to equal 255 as illustrated in Figure 
10(b). If the red component is then shifted back to its original position, the peak values of the 
red component are now only equal to 135 as illustrated in Figure 10(c). However, according to 

10 one embodiment of the invention, where the color space is not limited to 0 to 255, the color data 
greater than 255 is not lost or clipped when the red component is shifted by 120 as illustrated in 
figure 1 0(d). Since the peak values are not lost using the invention, when the red component is 
shifted back, all of the original information still remains as illustrated in Figure 10(e). 

Another clipping example is cubic interpolation. It simulates the sync function and the 

1 5 interpolated value can be negative. The RGB48 and ARGB64 formats can store those negative 
values without clipping. 

In general, the intermediate space is made as large as possible up to complex numbers. 
Quantum mechanics uses complex numbers to calculate the wave function. However, the final 
observable result is expressed as the absolute value of the wave function as the probability. 

20 Unless the complex numbers are kept in the intermediate state, the correct results cannot be 

obtained. The RGB48 and ARGB64 formats are aimed at this direction so that the intermediate 
states can have very wide range. The general Fourier transform produces the complex numbers. 
However, cosine or sine transforms are usually used to produce the real numbers. The RGB48 or 
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ARGB64 format can be used to store the convoluted coefficients of sine or cosine transform 
which require the signed numbers. 

In general, n-dimensional variables ^i, £ 2 ,. . .£n can be stored in the consecutive slots in 
the RGB48 and ARGB64. Then, the general transform for each variable can be applied. 

^,,..,» (I )=|^ l ...J^ fl g(^,.^ n ^ 1J ...,# l ,)/(# I ,...^ (i ) (21a) 

If there are inverse transforms, the inverse transformation can be written by 
nS^Zn) = \da> x \dQ) n G(4 n ,o) i ,...,o) n )F(co l ,...,o) n ) (21b) 

In both cases, the integral can be replaced with the summation, 2, if the considering 
variable is discrete. The examples of those transforms are Fourier transform, (discrete) Cosine 
and Sine transforms, Laplace transforms, etc. In addition, box filters and other filters can also be 
used. 

When the variable is a complex number, it can be saved in two components, one for the 
real part and the other for the imaginary part. The above equations can be used for the complex 
number and saved in the RGB48 and ARGB64 formats as well as in their variation forms. 

JPEG compression uses DCT (Discrete Cosine Transform), quantization, and Huffman 
encoding. In the lossy mode, either DCT or quatization is used. Since all of the above 
algorithms are well defined in negative numbers, JPEG compression algorithms can be used to 
compress RGB48 and ARGB64 images. Since those image formats are not defined in JPEG 
itself, the encoder and decoder need to be modified to be able to handle them. 

Although the invention has been described in connection with the preferred 
embodiments, it will be understood by those skilled in the art that many modifications can be 
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made thereto within the scope of the claims which follow. Accordingly, it is not intended that 
the scope of the invention be limited by the above description, but that it be determined by 
reference to the claims that follow. 
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